Papers with multi-dimensional framework
RCScore: Quantifying Response Consistency in Large Language Models (2025.emnlp-main)
Copied to clipboard
| Challenge: | Current evaluations of large language models rely on a single instruction template, overlooking models’ sensitivity to instruction style. |
| Approach: | They propose a multi-dimensional framework quantifying how instruction formulation affects model responses by transforming benchmark problems into multiple instruction styles. |
| Outcome: | The proposed framework reveals that instruction style can shift accuracy by 16.7% points. |
PanicToCalm: A Proactive Counseling Agent for Panic Attacks (2025.emnlp-main)
Copied to clipboard
| Challenge: | Existing models for training such models are limited due to ethical and logistical issues. |
| Approach: | They propose a dataset that includes high-distress episodes constructed from first-person narratives and structured around the principles of Psychological First Aid. |
| Outcome: | The proposed model outperforms baseline models in counselor-side metrics and client affect improvement. |